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I. INTRODUCTION 



Now that the Higgs-hke particle has been discovered in Large Hadron CoUider (LHC) 
2|, one of primary interests of particle physics is to understand mechanism of dynamical 
electroweak symmetry breaking. To settle down the unsolved issues including the hierarchy 
problem, there have been proposed several promising courses including supersymmetric, 
composite-Higgs and extra-dimensional models. Among them, the gauge-Higgs unification 
with extra dimensions js, 4| produces brilliant dynamics of gauge symmetry breaking, called 
the Hosotani mechanism ^-10|, with the Higgs particle as an extra-dimensional component 
of the gauge field: when adjoint fermions are introduced with periodic boundary condition 
(PBC) in gauge theory with a compact dimension, the compact-space component of the 
gauge field can develop a non-zero vacuum expectation value (VEV), which breaks the gauge 
symmetry to its subgroup spontaneously. This phenomenon originates in the non-abelian 
Aharonov-Bohm effect. There have be en p roposed a number of BSM models directly and 



indirectly based on this mechanism 
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Recently, the same phenomenon has been observed in a different context. As well-known, 
the imaginary time dimension is compacted in the finite-temperature (Quantum Chromo- 
dynamics) QCD. When the adjoint fermion is introduced with PBC in the theory, it was 



shown that exotic phases appear 



24j-|29l|. where the color trace of Polyakov line takes non- 



trivial VEV leading to the dynamical gauge symmetry breaking. This can be interpreted 
as i?^ X realization of the Hosotani mechanism. Further study is now required to under- 
stand detailed properties and phase diagram for this case. As for the five- dimensional gauge 
theory on x S^, lattice simulation is still at the sta ge t o understand the nature of 5D 
pure Yang- Mi 



in Ref. 
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Is theory. First attempt was done in Ref. [SOj and recent progress was shown 
53|. At the present, we have no detailed investigation on the phase structure of 
the five-dimensional gauge theory with dynamical quarks. 

The purpose of our work is to understand properties of gauge theories with quarks on 
i?^ X and x by using effective theories and show a guideline for further lattice 
simulations. We focus on the phase structure in SU{3) gauge theory by mainly using the 
perturbative one-loop effective potential. When we look into chiral properties, the Polyakov- 
loop-extended Nambu-Jona-Lasinio (PNJL) model 54j-l57l| is introduced. We obtain the 
phase diagram in the quark-mass and compacted-size space for several different choices of 
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fermion representations and boundary conditions. In the theory with adjoint fermions with 
PBC, we find rich phase diagram with unusual phases where SU{3) gauge symmetry is spon- 
taneously broken to SU{2) x U{1) (split phase) or x U{1) (re-confined phase). This 



result is consistent with the recent lattice simulations 25, 



29| and the perturbative calcula- 



tions for massless quarks [9|, Il0|- We show that chiral condensate is gradually decreased and 
the chiral symmetry is slowly restored with the compacted size being decreased although 
small chiral transitions coincide with the deconfined/split and split /reconfined transitions. 
We also study phase diagram for the case with both fundamental and adjoint quarks, and 
show that the split phase becomes more dominant as a result of the explicit breaking of 
Z3 center symmetry. This result indicates that the SU{'i) — )■ SU{2) x f/(l) phase, which 
is of significance in terms of phenomenology, can be controlled by adjusting the number of 
fundamental fiavors. In this case we point out that another unusual {U{1) x U{1)) phase 
with negative VEV of color-traced Polyakov loop emerges, which we call "pseudo-reconfined 
phase" . 

We note similar investigation on the phase diagram of compact-space gauge theory with 

where the authors focus on the volume indepen- 



PBC fermions were shown in 



24 



26 



dence of the vacuum structure from the viewpoint of the large N reduction 59|-66|. In order 
to reproduce the confined phase at low temperature, they used the gluon effective poten- 
tials with the mass- dimension parameter, which leads to explicit gauge symmetry breaking. 
Since these effective potentials do not suit our purpose of studying spontaneous gauge sym- 
metry breaking due to the Hosotani mechanism, we mainly use setups with manifest gauge 
symmetry. 

This paper is organized as following. In Sec. Ull we show our setups including the one-loop 
potential and the PNJL model. Sec. IIIII shows our numerical results for four dimensional 
cases. Sec. [IV]we show the results for five-dimensional cases. Sec. |V]is devoted to summary. 



II. EFFECTIVE POTENTIAL 



In this section we discuss our setups for SU(N) gauge theory. The one-loop effective 
potential is composed of two parts, gluonic and quark contributions. Since our goal is to 
study the phase diagram in terms of Wilson-line phases (Polyakov-line phases), {i = 
1, 2, N), we will write the effective potential as a function of these variables. Besides the 
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one-loop potential, we consider the contribution from the chiral part, which originates in 
the NJL-type four-point interactions. The total effective potential is then regarded as that 
of the PNJL model 55| as a function of the and the chiral condensate a. Depending on 
our purposes, we in some cases use only the perturbative one-loop effective potential, and 
in other cases use the PNJL effective potential. We also comment on possible deformation 
reflecting non-perturbative effects in the gluonic contribution. 

A. SU(N) in four dimensions 

We begin with one-loop effective potential for SU{N) gauge theory. In four dimensions, 
the finite-tempreature one-loop effective potential for gauge bosons and fermions is well 
studied in Ref. 0, 68|. What we do in the present study is just to regard the compacted 
imaginary-time direction as one of the spatial direction, and to replace T by 1/L where L 
is a size of the compacted dimension. 

Firstly, we rewrite the SU{N) gauge boson field as 

= {Ay) + i^, (1) 

where y stands for a compact direction and {Ay) is a vacuum expectation value (VEV) while 
A^ is fluctuation from it. The VEV can be replaced by 

(Ay) = ^g, (2) 

where g's color structure is diag(gi, q2, Qn) with qi + q2 + ■ ■ ■ + Qn-i + In = ^ and each 
component is determined as {qi)mod i- We note that eigenvalues of qi are invariant under all 
gauge transformations preserving boundary conditions. Then we can easily observe spon- 
taneous gauge symmetry breaking from values of q^ in the vacuum. For detailed argument 



on gauge transformation for this topic, see jo] for example. The gluon one- loop effective 
potential Vg is expressed as 

i,j=l n=l 

where qij = {qi — qj)mod i and is the number of color degrees of freedom. 
The contribution from massless fundamental quarks V/ is given by 

V cos[27rn(g, + 1/2)] 

i=l 71=1 
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where Nf is the number of fundamental flavors. Depending on boundary conditions, we 
should replace + 1/2 by qi + (p. For example, the choice of = describes quarks 
with periodic boundary conditions. From here, we denote Vj as effective potential of the 
fundamental fermion with boundary angle (p. The contribution from massive fundamental 
quarks is expressed by using the second kind of the modified Bessel function K2{x) as 

i=l n=l 

where is the fundamental fermion mass. (We assume the same mass for all flavors.) Here 
the second kind of the modified Bessel function K,Ax) is defined as 



\v roo 



Kjx) 



/CO 
e-"*(t2 - iy--2dt, (6) 



r(z/ + i/2) 

where T{x) is the gamma function. The adjoint quark contribution can be easily obtained 
by the following replacement, 

Vt{N,,ma) = E E(l - N^^=) \2 ^ cos[27rn(g,, + 0)], (7) 

i,j=l n=l 

where Na and rria are the number of flavors and the mass for adjoint fermions. For the gauge 
theory with Nf fundamental and A^^^ adjoint fermions with arbitrary boundary conditions, 
the total one-loop effective potential is given by 

V = V, + V^iNj, ruf) + Vt{N,, m,). (8) 

Now we consider contribution from the chiral sector. We introduce the four-point inter- 
action at the action level as 

gsiii'i^f + {i^ii^fi^fl (9) 

where -i/^ is a two-flavor fermion field and gs is the effective coupling constant with the mass 
dimension minus two. (We here concentrate on the two-flavor case.) By introducing the 
auxiliary field cr, we show that introduction of the above term ([9]) leads to addition of the 



following zero-temperature contribution to the one- loop effective potential ([8]) 28 1 



2+TlM/l + TT + TTlog 



(10) 



AV V ' A2 ' A4 " \^i + ^i + ^2/A2^ 

where A is a cutoff scale of the effective theory and rric stands for constituent quark mass 
nic = m — 2gsO'. Depending on fundamental or adjoint representations, (Ir takes or A^^ — 1 



respectively. In the case that we consider both fundamental and adjoint quarks, we need 
two different sets of chiral sectors. The total effective potential combined with the chiral 
contribution is then given by 



V + V, 



(11) 



This potential is valid for the weak-coupling region because it is basically based on the 
perturbative calculations, and chiral properties we obtain from it is at least valid for a small 
L region. We note that the cutoff scale A and the effective-coupling gs should be chosen to 
reproduce the known results. We note that this total effective potential is identical to that 
of the PNJL model {sS] adopting the one- loop potential as the gluon contribution. 



PNJL 



9' 



(12) 



with Dj = dj, D4 = 84 + iA^. We thus call the total effective potential (fTTll PNJL or 
PNJL-based effective potential. 

We here comment on the PNJL model. In the standard use of the PNJL model, the 
gluonic contribution Vg is replaced by the "no n-perturbatively" -deformed ones: in order to 
mimic the confinement /deconfinement phase transition in the study on QCD phase diagram,, 
the one-loop gluon potential should be replaced by some nonperturbative versions. We have 



27 



28l 



several schemes including the ones adopted in Ref. 
in Ref. 7l| and the strong-coupling lattice potential in Ref. 



69 



55 



70| . the one-loop ansatz used 
58|. In all the modifications 



able to reproduce the phase transition, however, the SU{N) gauge symmetry is explicitly 
broken due to the mass- dimension parameters. Since the non-perturbative modification does 
not suit our purpose of classifying the gauge-broken phases, we will mainly adopt one-loop 
effective potential as the gluonic contribution in our PNJL model and just discuss how the 
phase diagram is changed by the deformation in the next section. 



B. SU(N) in five dimensions 

In the five-dimensional case, most of the setup is parallel to the four-dimensional case 
except for difference of mass dimensions of fields and parameters. We here show the one- 
loop effective potential of gluon and quarks below. The five-dimensional one-loop effective 
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potential in the gluon sector is given by 

tt{^-^^.y-^^. (13) 



9 1 X \ cos{2nnqi 

i,j=l n=l 



which has dimension. The effective potential for massless fermions in this case is given 
by 

Vi/2 ^ J d^f^3 Ji^j^^ ^ g-L|k|+2..,- j + ln(l + e-^li^l-^-^"^ 
3 ^ cos[27rn(g-^- + 1/2)] 

n=l 

The effective potential of the massless fundamental and adjoint fermions with arbitrary 
boundary condition is expressed as 

^,0 _ 3A^/ cos[27rn(g, + 0)] 

i=l n=l 

^,4> - ^^<^ ^^f, 1 X A cos[27rn(g^j + 0)] 

ij'=l n=l 

For the massive fermion, we should replace |k| by i?p = a/p^ + w? in Eq. f|T^ . To evaluate 
the integration, we should expand the logarithm in the same way as the four dimesional case. 
Individual integration is done by using the Bessel function as 

m \ 3/2 



n Jq n? dL Ji 



n? ^TT dL 

^±2i7rnq^^ 2^/2^ / m \ 3/2 



Then, the potential contributions from massive fermions are obtained by using the K^/2{x) 
as 

i=l n=l 

Vt{Na,ma) = l^l^y-- J^^^j) cos[27rn(g,,- + 0)]. (19) 

i,j=l n=l 

We here comment on treatment of parity pairs. When we need a parity-even mass term in 
odd dimensions (e.g. Z2 orbifolded theory), we need a set of parity pairs 4''^{—y) = ^ipiu) 



in the action 



12| . Although our study does not take much care about such a case, we note 



that the factor two appears in front of the fermion potentials if the parity pair is introduced. 
It is thus the same situation as doubled flavors within this setup. In Sec. IIV[ we will see that 
the phase diagram changes depending on the choice of the parity pair in five dimensions. 



III. PHASE STRUCTURE IN FOUR DIMENSIONS 

In this section, we investigate the phase structure in the compacted-size and quark- 
mass m space for SUi?)) gauge theories on x . Because of the relation — ^3 = gi + ^2, 
the vacuum structure is discussed just from the (gi, ^2) potential. In the following we begin 
with investigation on vacuum and phase structures based on the one-loop potential ([8]) 
for several choices of matters and boundary conditions. We note that we will sometimes 
consider one-flavor cases as (A^/, A^^) = (0, 1) or (A^j, A^^) = (1, !)• Since the anomaly is not 
implemented and difference of one- and multiple-flavors just appears as an overall factor in 
the effective potential, our four- dimensional results are qualitatively unchanged even for the 
two-flavor CcLSGS cLS {Nf,Na) = (0,2) or {Nf,Na) = (2,2). Thus, these one-flavor examples 
are sufficient for our purpose of studying phase diagram qualitatively. (Things are different 
in five dimensions as shown in Sec. II VI ) 

In the appendix. \^ we summarize the potential minima for gauge-symmetry-preserved 
cases, which are not our main results. We show the contour plots of the effective potentials 
for {Nf, No) = (0, 0) in Fig. [191 (^/) ^a) = (1, 0) with the anti-periodic boundary condition 
(aPBC) in Fig. [201 {Nf, A'a) = (1, 0) with the periodic boundary condition (PEC) in Fig. [211 
and {Nf,Na) = (0, 1) with aPBC in Fig. [221 We set rrif = rua = in these cases. In the 
pure-gauge and gauge+adjoint theories, the three degenerate vacua clearly reflects the Z3 
center symmetry while the introduction of fundamental fermions lift of the degeneracy, which 
means breaking of the center symmetry. We note that the global minima are given by any of 
(?i) Q2) = (0, 0), (1/3, 1/3), (—1/3, —1/3), and we have qi = q2 = Qs (mod 1) in the vacuum. 
It obviously shows that the SU{3) symmetry remains in all these cases. 

Now, we shall look into the case with spontaneous gauge symmetry breaking. We consider 
{Nf, Na) = (0, 1) with PBC We note that this theory has exact center symmetry, and all 
the phases, even the gauge-broken phase, should reflect this symmetry. Figure [T] shows the 
effective potential [Vg + V°]L^. The left contour plot is obviously different from the gauge- 
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FIG. 1: The one-loop effective potential of SU{3) gauge theory on x with one adjoint 
fermion with PBC [Vg + V^{Na = l,ma = 0)]L'^. (Right) The contour plot as a function of qi and 
52- Thicker region stands for deeper region of the potential. (Left) The effective potential as a 
function of qi with q2 = 0. The global minima are located at {qi, ^2) = (il/3, 0). 

symmetric cases. Careful search shows that the minima are located at {qi,q2) = (0,1/3), 
(1/3,0), (-1/3,1/3), (-1/3,0), (0,-1/3), (1/3,-1/3). It means the vacua are given by 
permutations of {qi,q2,<l3) = (0,1/3,-1/3), and SU{3) gauge symmetry is broken into 
U{1) X f/(l). This is the famous result, known as the Hosotani mechanism, where the 
laronov-Bohm effect in the compacted dimension nontrivially breaks gauge symmetry 



291] since 



A 

, ll^ . We note that this situation is sometimes called "re-confined phase" 
the color fundamental trace of the Polyakov loop ^ = Ttf P becomes zero. 

To study the phase diagram, we introduce nonzero quark mass. Figure [2] shows the 
effective potential [V^ + V^{Na, ■ma)]L^ as a function of gi with ^2 = for mL = 1.2, 1.6, 2.0 
and 3.0 from left to right panels (m = rria). It is clearly seen that there is the first-order 
phase transition in the vicinity of mL = 1.6. This is a transition between the re-confined 

n 

phase and the other gauge-broken phase, which we call the "split phase" [29|]. The contour 
plots for mL = 1.6 and mL = 1.8 are shown in Fig. [3l The mL = 1.8 case corresponds to 
the split phase. The global minima in the split phase are given by 

• Im $ = : (gi,g2) = (0,0.5), (0.5,0.5), (0.5,0), 

. Im $ > : (gi, g2) = (1/6, -1/3), (-1/3, 1/6), (1/6, 1/6), 
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. Im $ < : (gi, q^) = (1/3, -1/6), (-1/6, -1/6), (-1/6, 1/3). 

These results indicate that the vacuum in the first set is given by permutations of (gi, ^2, ga) = 
(0, 0.5, 0.5), and 5'f/(3) gauge symmetry is broken into SU (2) x[/(l). The vacua for other two 
sets are derived by the Z3 transformation of (gi, g2, gs) = (0, 0.5, 0.5). From the viewpoint of 
phenomenological symmetry breaking, this phase and similar phases for large color numbers 
are the most preferable. 

In Fig. Hlwe depict the L~^-m phase diagram with one PBC adjoint quark {Nf,Na) = 
(0, 1) based on the one-loop effective potential. We note that, as m appears as mL in this 
one-loop effective potential, we have scaling in the phase diagram and we can choose arbitrary 
mass- dimension unit. Since we drop the non-perturbative effect in the gluon potential, we 
have no confined phase at small (at low temperature). The order of the three phases 
in Fig. H (deconfined SU{3) split SU{2) x f/(l) reconfined f/(l) x U{1) from small to 
large L~^.) is consistent with that of the lattice simulation except that we have no confined 
phase. We note that all the critical lines in the figure are first-order. In Fig. [5] we depict a 
schematic distribution plot of ^ in the complex plane. It is obvious that each phase reflects 
Z3 symmetry. In the split phase, $ takes nonzero values but in a different manner from 
the deconfined phase. In the re-confined phase, we exactly have $ = with the vacuum 
breaking the gauge symmetry. 




FIG. 2: The one-loop effective potential of SU{3) gauge theory on R"^ x with one PBC adjoint 
quark as a function of qi with q2 = [Vg + V^Ji^, for niL = 1.2 (reconfined), 1.6 (reconfinedo- split), 
2.0 (splitodeconfined) and 3.0 (deconfined). 

We next turn on the chiral sector and consider the PNJL effective potential (ITT]) . We 



investigate chiral properties of {Nf,Na) = (0,2) SU{3) gauge theory on x 5*^. |79 |. 
Before proceeding to the main topic, we discuss validity of the effective model (ITT]) for 
the purpose of studying chiral properties at weak-coupling region. Although we have no 
confined phase nor confined/deconfined phase transition in our model, the chiral restoration 
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FIG. 3: Contour plot of the one-loop effective potential of 5C/(3) gauge theory on B? x with 
one PBC adjoint quark [(V^jpert + V^JL^, for mL = 1.6 and 1.8 {SU{2) x U{1) split phase) as a 
function of qi and q2- Thicker region indicates deeper region of the potential. 
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FIG. 4: L^^-m phase diagram for 5C/(3) gauge theory on B? x with one PBC adjoint quark based 
on one-loop effective potential. D stands for "deconfined (S'C/(3))", S for "split {SU{2) x f/(l))" 
and R for "re-confined {U{1) x f/(l))" phases. Phase transitions are first-order. 

associated with the phase transition is correctly reproduced in this model for the known 
cases: {Nf, Na) = (2, 0) with aPBC, (Nf, Na) = (2, 0) with PBC and {Nf, Na) = (0, 2) with 
aPBC We depict behavior of the constituent mass for these cases in Fig. El where the chiral 
phase transition takes place at some point for the three cases. The parameters are chosen 
so as to have the correct critical temperatures in finite-temperature SU{3) gauge theory 



with aPBC quarks 72|, |73||, A = 0.63 GeV and gs-^"^ = 2.19 for fundamental quarks and 



A = 23.22 GeV and ^^A^ = 0.63 for adjoint quarks 



28|. 
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FIG. 5: Schematic distribution plot of Polyakov loop $ as a function of Re $ and Im for SU{3) 
gauge theory on x with one PBC adjoint quark. 

We are now convinced that the model can work to study chiral properties, and we go on 
to the main topic, {Nf,Na) = (0,2) with PBC. We calculate the PNJL effective potential 
in Eq. (fTT]) and search for the vacua for qi, q2 and cr. We depict the phase diagram for this 
case in Fig. [3 Due to nonzero constituent mass, the whole phase diagram is shifted, and 
we have phase transitions even for a = massless case. We also note that the critical 
lines are curved due to the dimensionful parameters introduced. Although our analysis is 
valid only for the weak-coupling regime, the phase diagram is qualitatively consistent with 



25 



29| except that ours have no confinement /deconfinement 



that of the lattice simulations 
phase transition. 

To look into chiral properties, we simultaneously depict the real part of VEV of Polyakov 
loop $ and the constituent mass rric as a function of with the bare mass fixed as m = 
GeV and m = 1 GeV in Fig.[Hl We here normalize the constituent mass as mc{L^)/mc{L~^ = 
0). It is notable that chiral condensate, or equivalently, constituent quark mass does not 
undergo a clear transition even for large values of L~^, and it gradually decreases. We thus 
have no clear chiral restoration transition while chiral symmetry is gradually restored in 



this theory. This resu. 
the lattice simulation 



t and the standard-PNJL result in 



are consistent with those of 



29I, which argues that the chiral restoration at weak coupling should 
occur at a quite small value of the compacted size L. The other notable point is that the 
chiral condensate undergoes quite small transitions coinciding with the deconfined/split and 
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FIG. 6: Constituent mass as a function of for {Nf,Na) = (2,0) with aPBC, {Nf,Na) = 
(2,0) with PBC, {Nf,Na) = (0,2) with aPBC and {Nf,Na) = (2,0) with PEG with the bare 
mass fixed as m = GeV. We choose the parameter set as A = 0.63 GeV and gs-^"^ = 2.19 for 
fundamental cases and A = 23.22 GeV and gsA^ = 0.63 for adjoint cases. 



split /re-confined phase transitions. (It can be seen better in Fig. [6] or the right pane 
m = 1 GeV in Fig. [8l) This kind of the transition propagation is well studied in 0, 



for 

3, 



but they may be too small to be observed in the lattice simulations. 

Let us briefly comment on non-perturbative deformation of the gluon potential discussed 
in Sec. [Tll We show one of the examples of the deformations in Eq. flAl|) in Appendix. El 
where introduction of the mass- dimension parameter M is not appropriate for the present 
purpose. Indeed, if we introduce this deformation (M = 596 MeV), the phase diagram in 
Fig. m is midified as Fig. [23l Here the confined phase emerges at small region, but it 
is connected with the re-confined phase through the small mass region. This result clearly 
shows that the gauge symmetry is broken as SU{3) — t- f/(l) x U{1) at zero-temperature or 
infinite-L. We note that the similar result with the same deformation in the gluon potential 
is shown in Ref. where it is argued that the unified confined phase implies the volume- 
independece of the confined phase structure. This topic is beyond our scope, and we will 
not discuss it anymore. 

We next consider {Nf, Na) = (1, 1) with PBC. We concentrate on the case with a massless 
fundamental quark, and the potential is given by Vg+V^^Nj = 1, m/ = 0)+V^(A'a = 1, nia = 
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1/L [GeV] 



FIG. 7: L^^-m phase diagram for SU{3) gauge theory on x with two-flavor PBC adjoint 
quarks {Nf,Na) = (0,2) based on the PNJL-type effective potential. D stands for "deconfined", S 
for "spht" and R for "re-confined" phases. Critical lines are first-order. 

m = 1 GeV 

m,(L'')/m,(L''=0) 

R <S> 



S 

2 4 """" 2 4 

1/L [GeV] 1/L [GeV] 

FIG. 8: VEV of Polyakov loop $ (blue dashed) with ^2 = and the constituent mass rric (red 
solid) as a function of with the bare mass fixed as m = GeV (left) and m = 1 GeV (right). 
The constituent mass is normalized as mc{L^^) / mc{L^^ = 0). The result indicates that the chiral 
symmetry is gradually restored without the clear phase transition. 

m). In this case, since the fundamental quark breaks the center symmetry, the minima 
at Re$ < become true vacua in the deconfined and split phases as shown in Fig. [91 
(Fundamental matter with PBC moves the vacua to Re$ < direction.) In addition, we 
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have no exact re-confiend phase since $ = vacuum cannot be chosen because of the center 
symmetry breaking in Fig. |9l We term this unusual phase as "pseudo-reconfined phase" , 
where the SU{3) is broken to U{1) x U{1) and $ takes a nonzero and negative value. 
The existence of this phase is consistent with the research on flavor-number dependence 
of gauge-symmetry-broken manners in Ref. 8|]. In Fig. [TDl we depict the phase diagram 
for the same case. We emphasize that the split phase gets larger by introducing PBC 
fundamental quarks, compared to Fig. HI It is because the center symmetry breaking chooses 
(gi, q2, qs) = (0, 0.5, 0.5) and its permutations as true vacua among all the possible minima 
Fig. [HI and makes it more stable than the center-symmetric case in Fig. 



Im 3> 



D 



,-- PC" 



FIG. 9: Schematic distribution plot of Polyakov loop <I> for SU{3) gauge theory on x with 
one PBC adjoint and one PBC massless fundamental quarks {Nf,Na) = (1, 1). Points painted over 
stand for vacua in this case. symmetry is broken, and some of the three minima are chosen 
as true vacua in deconfined and split phase. The Polyakov loop <I> in the pseudo-reconfined phase 
(PC) takes a nonzero and negative value. 

To look into the details of pseudo-reconfined phase and the phase transition to the split 
phase, we depict the expanded effective potential near the global minima as a function 
of qi with g2 = in Fig. [TT] The left panel shows the result for the massless adjoint 
quark {rria = m = 0), which corresponds to the pseudo-confined phase. The minimum is 
not located at (gi,g2) = (0.5, 0)(split case) nor at (gi,g2) = (1/3, 0) (re-confined case). In 
the pseudo-confined phase we totally have six minima for qi and q2 as {qi,q2) ~ (0,0.4), 
(0.4,0), (-0.4,0.4), (-0.4,0), (0,-0.4), (0.4,-0.4), which means that the vacua are given 
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FIG. 10: Phase diagram for x SU{3) gauge theory with one PBC adjoint and one massless 
PBC fundamental quarks {Nf,Na) = (1,1) based on the one-loop effective potential, m is the 
adjoint quark mass m = rua and is the inverse of the compacted size. PC stands for "pseudo- 
reconfined" phase. 

by the permutation of (gi, q2, qs) ~ (0, 0.4, —0.4). The right panel shows the first-order phase 
transition between pseudo-confined and spht phases. Since the potential barrier at the phase 
transition is quite low, the fluctuation could break down clear phase transition. For the cases 
with {Nf, No) = (1, 2) and {Nf, Na) = (1, 3) where the flavor of adjoint quarks is larger than 
that of fundamental quarks, the minima of the potential in the pseudo-reconfined phase 
becomes deeper, and we can observe the first-order phase transition more distinctly. 
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FIG. 11: Expanded effective potential of x SU{3) gauge theory with one PBC adjoint and 
one massless PBC fundamental quarks as a function of qi with q2 = 0. Left one shows the case 
with the pseudo-reconfined phase (m = nia = 0), where we have the minimum at (qi, ^2) ~ (0.4, 0). 
Right one shows the first-order phase transition between the pseudo-reconfined and split phase at 
niaL = 0.77. 

The chiral sector can be introduced by extending to {Nf,Na) = (2,2). In this case we 
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have two chiral sectors for fundamental and adjoint quarks, and we have arbitrariness how 
to implement four-point interactions and choose relative parameters. For example, we may 
consider the following forms of the four-point interactions. 

+ {9s)fa[{ii'f^f) + (^/^75r^/)}{(V'aV'a) + (V-a^TsT^a)}], (20) 

where ipf and ipa stand for fundamental and adjoint quark fields, and {gs)f,{gs)a,{gs)fa 
stand for fundamental, adjoint and mixing effective coupling. Even if we fix a form of the 
four-point interactions, we still have no criterion on how to set the parameters since there 
is no lattice study on this case either for aPBC or PBC. Thus we just comment on general 
aspects of the chiral properties in this case. For {Nf, Na) = (2, 0) with PBC, we know 
that we have the chiral phase transition as with that of aPBC as shown in Fig. [61 If this 
phase transition persists in the {Nf, Nf) = (2, 2) case with PBC, chiral phase transition of 
the adjoint quarks could coincide with that of the fundamental chiral condensate HQ. 
In such a scenario, the chiral phase diagram could be much richer than Fig. [8l However, 
whether this situation takes place depends on parameter sets {{gs)f,{gs)a,{gs)fa), which 
can be fixed by using coming lattice data. We devote full investigation on this topic to 
future study. 

Besides the cases we have shown above, we also have other interesting choices of matters. 



As shown in 76|, the SU{3) gauge theory with three fundamental flavors with flavored 
twisted boundary conditions = 0, 1/3, 2/3 can accidentally keep the Z3 center symmetry. 
For example, in the case of {Nf, No) = (3, 1) with the flavored twisted boundary conditions 
= 0, 1/3, 2/3 for fundamental fermions and PBC for the adjoint fermion, the distribution 
plot of $ becomes symmetric as Fig. [5] and we have exact re-confined phase although the 
theory contains fundamental quarks. Moreover, in [t^ , the present authors and collaborators 
discuss the SU{3) gauge theory with {Nf,Na) = (3,0) with the flavored twisted boundary 
conditions = 0, 1/3, 2/3 can lead to the spontaneous gauge symmetry breaking without 
adjoint quarks. This case is also fascinating as a future research topic. 
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IV. PHASE STRUCTURE IN FIVE DIMENSIONS 



In this section, we discuss the vacuum and phase structure in SU{3) gauge theories on 
X S^. Since the five- dimensional gauge theory is not renormahzable, we cannot discuss 
its non-perturbative aspects in a parallel way to the four- dimensional case. Thus we will 
concentrate on the one-loop part of the effective theory, and will not consider the contribution 
from the chiral sector. It is sufficient for our purpose of investigating the phase structure at 
weak-coupling. 

We consider the five- dimensional one-loop effective potential [V^ + Vf{Nf,mf) + 
V^{Na,ma)]L^. We first look at the case with {Nf,Na) = (0,1) with PBC. The qualita- 
tive properties are common with the four-dimensional case. Figure [T2] shows the effective 
potential [Vg + V^{Na = l,m)]L^ ClS db function of qi with q2 = fixed. The adjoint quark 
mass is set as mL = 0.5, 1.3 and 2.0 from left to right panels. The three cases corre- 
spond to re-confined (left), split (center), and deconfined (right) phase. The contour plots 
at mL = 0.5(reconfined) and mL = 1.3(split) are depicted in Fig. [131 The manners of 
SU{3) symmetry breaking and the distribution of Polyakov line $ in each phase are the 
same as the four- dimensional case; SU{3) — )■ f/(l) x f/(l) in the re-confined phase and 
SU{3) — i- SU(2) X f/(l) in the split phase. We depict the phase diagram in L~^-m for 
this case in Fig. [HI The qualitative configuration of the three phases in the phase dia- 
gram is indifferent from the four- dimensional case although the split phase is smaller in five 
dimensions. 




FIG. 12: The one-loop effective potential of SU{?>) gauge theory on R'^ x 5"^ with one PBC adjoint 
quark as a function of qi with ^2 = (V^ + V^(l, m))L^ . Depicted for mL = 0.5 (re-confined), 1.3 
(split) and 2.0 (deconfined). 

We next consider the case for {Nf,Na) = (1,1) with PBC. We again concentrate on 
mj = 0. Due to explicit breaking of center symmetry, $ < minima are chosen as 
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FIG. 13: Contour plot of the one-loop effective potential of SU{3) gauge theory on R'^ x with 
one PBC adjoint quark (Vg + V^{Na = I, ma = m))L^ for mL = 0.5 and 1.3 as a function of qi 
and q2- 
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FIG. 14: L ^-nia phase diagram for SU{3) gauge theory on x with one PBC adjoint quark 
based on the one-loop effective potential. 

vacua in the deconfined and split phases in the same way as the four dimensional case 
(Fig. |9]). It is notable that the split phase is again enlarged by introducing fundamental 
fermions, but more effectively in five dimensions. Enhancement of the split phase due to the 
fundamental matter in five dimensions is sensitive to choice of parity pairs, or equivalently, 
choice of the number of flavors. For {Nf,Na) = (1, 1) without the parity pair, the pseudo- 
confined phase disappears and the split phase becomes the unique gauge-broken phase as 
shown in Fig. [151 This result is consistent with that of the massless case (m^ = 0) in 
Ref. jol, Q. On the other hand, when we introduce parity pairs for {Nf,Na) = (1,1) or 
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equivalently consider {Nf,Na) = (2,2), the split phase becomes wider than that in Fig. [H] 
but the pseudo-reconfined phase still survives as shown in Fig. [161 In the five-dimensional 
pseudo-confined phase we again have six minima for qi and q2 as (gi, 52) ~ (0, 0.4), (0.4, 0), 
(—0.4,0.4), (—0.4,0), (0,-0.4), (0.4,-0.4), which inidicates that the minima are given by 
the permutation of {qi,q2,<l3) ~ (0,0.4,-0.4). We depict the expanded effective potential 
in Fig. [T71 The left panel shows the massless case {maL = 0), which corresponds to the 
pseudo-reconfined phase. The right panel shows the first-order phase transition between the 
pseudo-reconfined and split phases {niaL = 1.18). In the cases with {Nf,Na) = (1,2) or 
{Nf, No) = (1, 3), the potential minima in the pseudo-reconfined phase becomes deeper and 
the phase transition gets more distinct. 
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FIG. 15: L^^-nia phase diagram for SU{3) gauge theory on i?^ x with one adjoint and one 
massless fundamental quarks {{Nf,Na) = (1,1), "mj = 0, PBC) based on the one-loop effective 
potential. 
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FIG. 16: L~^-ma phase diagram for SU{3) gauge theory on R'^ x with a set of parity pairs of 
{Nf,Na) = (1,1), or equivalently (Nf,Na) = (2,2), based on the one-loop effective potential. 





20 




FIG. 17: Expanded 5D effective potential of SU (3) gauge theory on ii^ x with a set of parity 
pairs of {Nf,Na) = (1,1) or {Nf,Na) = (2,2) as a function of qi with q2 = 0. Left one shows 
the pseudo-confined phase (m = = 0), where we have the minimum at {qi,q2) ~ (0.4,0). 
Right one shows the first-order phase transition between the pseudo-reconfined and split phase at 
niaL = 1.18. 

In the end of this section we comment on the other aspect of gauge theory with a com- 
pacted dimension. If we regard the compacted direction as time direction, the boundary 
condition for the Polyakov-loop phases can be seen as imaginary chemical potential. The 
periodic and anti-periodic boundary conditions correspond to different Roberge- Weiss tran- 
sition points on the QCD phase diagram. From this viewpoint, it is clear that fundamental 
fermions with PBC works to move the vacua to Re$ < direction as shown in Fig. [9] while 
those with aPBC move it to Re'l' > direction as shown in Fig. [18] 

V. SUMMARY 

In this paper we have studied the phase diagram for SU (3) gauge theories with a compact 
spatial dimension by using the effective models, with emphasis on the dynamical gauge 
symmetry breaking. We show that introduction of adjoint matter with periodic boundary 
condition leads to the unusual phases with spontaneous gauge symmetry breaking, whose 
ranges are controlled by intorducing fundamental matter. We also study chiral properties 
in these theories and show that the chiral condensate remains nonzero even at a small 
compacted size. 

In Sec. ini we developed our setup based on one-loop effective potential and four-point 
fermion interactions. The effective potential is composed of the gluon, quark and chiral 
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FIG. 18: Schematic distribution plot of Polyakov loop $ for SU(3) gauge theory with one PBC 
adjoint and one aPBC fundamental quarks. Points painted over stand for vacua in this case. Z3 
symmetry is broken in the different manner from Fig. O 

sectors. The total effective potential corresponds to that of the PNJL model with one-loop 
gluon potential. This setup is effective enough to investigate vacuum structure and chiral 
properties at weak-coupling or small size of the compact dimension. 

In Sec. mil we elucidated the vacuum and phase structure in S'f/(3) gauge theory on 
B? X . The theory with PBC adjoint quarks has three different phases in the L~^-m 
space, including the deconfined phase {SU{3), nonzero $), the split phase {SU{2) x f/(l), 
nonzero $) and the re-confined phase (f/(l) x f/(l), zero $ with nontrivial global minima). 
The configuration of these phases in the phase diagram is consistent with that of the lattice 
calculations although we have no confined phase. By using the PNJL effective potential, we 
argued that chiral symmetry is slowly restored without clear phase transition when the size 
of the compact dimension is decreased. In this section we also studied vacuum and phase 
structure for the case with both fundamental and adjoint matters, and showed that the split 
phase is generically widened by adding PBC fundamental quarks. We consider that it is 
because one of the three possible minima for the split phase becomes more stable due to 
the center symmetry breaking. We showed that another U{1) x f/(l) phase with a negative 
value of $ emerges in this case (pseudo-reconfined phase). 

In Sec. HYI we studied the vacuum and phase structure in SU(3) gauge theory on R^x S^. 
In the five- dimensional case we concentrate on the one-loop part of the effective potential. 
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The theory with PBC adjoint quarks again has the spht {SU{2) x U{1)) and re-confined 
(f/(l) X f/(l)) phases. Introduction of fundamental quarks works to enlarge the split phase 
more effectively than the four- dimensional case. Especially in the case with one adjoint 
and one fundamental quarks without parity pairs, the split phase overcomes the pseudo- 
reconfined phase and becomes a unique gauge-symmetry-broken phase. 

In the end of the paper, we discuss whether the lattice simulation can check our pre- 
dictions. One of our main results is that enlargement of the split phase in the presence 
of fundamental fermions. This property would be observed in the on-going lattice simula- 
tions on four-dimesional gauge theory with a compact direction 78|. The pseudo-reconfined 
phase can be also observed where the VEV of Polyakov loop becomes negative but different 
from that of the split phase. On the other hand, it seems difficult to show the first-order 
phase transition between the pseudo-reconfined and split phases. The lattice calculation can 
check whether chiral condensate remains finite in the re-confined phase even at a very small 
compacted size. The small chiral transitions coinciding with the gauge-symmetry phase 
transitions are subtle. If the lattice simulation succeeds to measure chiral susceptibility 
with high precision, this phenomena may be able to be observed. 

During preparing this draft, the collaboration [78,] kindly informed us that it also per- 
formed perturbative calculations on the phase diagram in gauge theory on x and 

X S^. It could be valuable for readers to compare the results from the two independent 
groups. 
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Appendix A: Vacua and phase structures for other cases 
1. Gauge symmetric cases 

In this appendix, we discuss the vacuum structure for the several gauge- symmetric cases 
in X SU{3) gauge theory. We concentrate on massless cases as rria = rrif = 0. The 
potential contour plot for {Nf, No) = (0, 0) (pure gauge theory) is shown in Fig. [191 The 
effective potential has the minima at (gi,g2) = (0,0), (1/3,1/3), (—1/3,-1/3). Since it 
means that the three Polyakov-line phases are equivalent in the vacuum {qi = q2 = Qs), the 
SU{3) gauge symmetry is intact. 

The case with one fundamental fermion with anti-periodic boundary condition is shown 
in Fig. [20l The fundamental quark breaks symmetry explicitly and thus, two of the three 
minima become the meta-stable. If the boundary condition of fermion is changed to the 
periodic one, the global minima move to (±1/3, ±1/3) as shown in Fig. |2T1 On the other 
hand, the case for an adjoint fermion with anti-periodic boundary condition is similar to the 
pure gauge case as shown in Fig. since it keeps the center symmetry. 




FIG. 19: The contour plot of one-loop effective potential for pure SU{3) gauge theory, VgL^ as a 
function of qi and q2- Thicker region stands for deeper region of the effective potential. 
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FIG. 20: The contour plot of one-loop effective potential for x SU{3) gauge theory with 
one massless fundamental fermion with anti-periodic boundary condition {{Nf,Na) = (1,0) with 
aPBC) (Vg + Vy^)L\ 
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FIG. 21: The contour plot of one-loop effective potential for i?^ x SU{3) gauge theory with one 
fundamental fermion with periodic boundary condition {{Nf,Na) = (1,0) with PBC) {Vg + Vj)L^. 

2. Phase diagram with non-perturbative deformation 

In Fig. 1231 we depict the phase diagram for x SU (3) gauge theory with {Nf, No) = 
(0, 1) with PBC based on the nonperturbatively deformed gluonic potential. As an example, 
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FIG. 22: The contour plot of one-loop effective potential for E? x SU{3) gauge theory with 
the Na = 1 adjoint fermion with anti-periodic boundary condition {(Nf,Na) = (0, 1) with aPBC) 



we consider the following modification from the perturbative potential in 271 . 

N oo /„ , ,9 N 00 



28|, 



69 



7Q|: 
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L%2 



i,j=l n=l 



i,j=l n=l 



cos(2n7rg 



(Al) 



where M is the mass-dimension 1 parameter. We set the scale parameter as M = 596 
MeV. The confined phase and the first-order phase transition show up, but it is merged into 
the gauge-broken re-confined phase. We note that the SU{3) gauge symmetry is explicitly 
broken in the confined (re-confined) phase. 
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